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ABSTRACT 

The method o£ [l] for obtaining an approximate lower 
J00(1-Q')% confidence limit on System Reliability is used, except, 
instead of a Gamma probability distribution, a Normal probability 
distribution is used as the underlying distribution for §, the 

estimator of the negative natural logarithm of system reliability. 

■* f 

An investigation is made of the errors involved in the 
truncations and approximations used throughout the development. 

A continuity correction factor is developed, and confidence 
limits on system reliability, resulting from computer simulation, 
are presented both with and without the inclusion of this con- 
tinuity correction factor. 
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1. INTRODUCTION 



An ad hoc procedure for obtaining an approximate confidence 
interval for system reliability has been developed, based upon 
Bernoulli test data from unequal samples of the various compo- 
nents of the system [l]<> Integral to this procedure is an 
assumption that the unbiased estimator of the negative natural 
logarithm of system reliability may be approximated by the 
Gamma probability distribution. It was the purpose of this 
thesis to (1) investigate the errors in the above mentioned 
procedure (hereafter called the Woods-Borsting Method) resulting 
from truncation and approximation; (2) develop a different con- 
fidence interval, using the same ad hoc procedure, but assuming 
an underlying normal probability distribution, vice Gamma, on 
the unbiased estimator of the negative natural logarithm of 
system reliability; and (3) compare the confidence limits 
resulting from both procedures for various values of the para- 
meters involved. 

That the investigation which follows was ever undertaken is 

primarily justified by the results obtained under the Gamma 

distribution assumption. As will be explained below, the Q' t * 1 

percentile of the simulated distribution of the lower confidence 

limit, call it R / and true system reliability, R , should 
o iL^Qf ji S 

be the same; hence, the absolute value of their difference can 
be used as a measure of the accuracy of the Woods-Borsting 
Method. In one case the magnitude of this difference was .18 
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and the average difference was .036* The above figures, coupled 
with the realization by the author's of the need for error 
analysis, motivated the undertaking of this thesis. 

Although any one of several probability laws could have been 
chosen to supplant the Gamma distribution used in the Woods- 
Borsting Method, this investigation is limited to only one, the 
normal distribution. If we write the negative natural logarithm 
of system reliability as -In Rg and define this quantity,' for 
simplicity of notation, to be identically equal to S, then it 
will be seen below that two sources of error are directly related 
to S. The first is an error of truncation of an infinite series 
expansion of In R g . The second is an error of approximation in 
the expression for Var (S) , where is the unbiased estimator 
for S. 

Error analysis is performed on the former, but not on the 
latter, because it is felt that, due to the complexity of the 
expression dropped in the approximation, this would, in itself, 
be subject matter sufficient for a thesis. 

In the following sections, the necessary background is first 
presented, which includes an explanation of the Woods-Borsting 
Method, the investigation of the two above mentioned errors, the 
formal introduction of the normal distribution assumption, and 
the mathematical development of a new confidence interval based 
on this assumption of normality. 

In Section 3, the lower confidence limit, taken from the 
confidence interval, is seen to a function of random variables. 
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and hence has some underlying probability distribution. This 
probability distribution is simulated by digital computer, the 
shape of the distribution, and the reasons therefor , are 
discussed, the results are presented in tabled form, and com- 
pared to the results of the same simulation of the Woods-Borsting 
Method. It will be seen that the results are in need of improve- 
ment, leading to Section 4. 

In Section 4, a continuity correction factor is developed, 

A 

necessitated by the fact that S, assumed to be a continuous random 
variable, can, in reality, take on only discrete values. This 
continuity correction factor is then incorporated in the con- 
fidence limit, the distribution of this new random variable sim- 
ulated, the results tabulated, and comparison made to both the 
results of Section 3 and the Woods-Borsting Method. 

In the last section, a summary comparison is made, in a con- 
densed tabular .form ,:4nd in the text, of the results of the pre- 
ceding two sections, the Woods-Borsting Method, and a well-known 
method of estimating system reliability when all component sample 
sizes are the same, based on the Poisson approximation to the 
Binomial distribution. Conclusions are made as to the accept- 
ability of the Normal assumption over the Gamma, and to the 
extent to which the addition of the continuity correction factor 
increases the accuracy. 

Ever since automation and advancirg technology began to 
increase the complexity of various equipments, particularly 
military weapons systems, the purchasers, and consequently the 
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producers, of these equipments have become increasingly more 
aware of the necessity for predicting the overall reliability 
of these equipments o Many problems in the mathematical theory 
of reliability have been solved, but one that has not is that 
of obtaining a confidence interval on system reliability when 
the reliability of the system is to be computed as the product 
of the various component reliabilities, and the sizes of the 
test samples taken of the various components are not all equal. 

If component sample sizes are all equal, there exists a well- 
known method of obtaining a confidence interval on system re- 
liability, based on the Poisson approximation to the Binomial, 
as explained in [l], p, 2, and [3], pp» 218-219. However, when 
one considers that components of complex systems are being built 
by different sub-contractors in different geographical locations, 
that these components are not mass produced, rather only a rela- 
tively small quantity of each are ever manufactured, and that 
samples are drawn for reliability testing before the whole system 
is ever assembled, then the only conclusion is that sample sizes 
of components will rarely be the same, except by accident, not 
design. Hence, there is a definite need for a method of obtain- 
ing a confidence interval on system reliability, based upon 
varying sample sizes of components. Using the work done in [l] 
as a foundation, this thesis is an attempt to move toward the 
solution of this problem. 
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2. BACKGROUND 



In this section the Woods -Bor sting Method is explained and 
the mathematical development shown, errors in the Woods-Borsting 
Method due to truncation and approximation are pointed out and 
investigated, the assumption of an underlying normal probability 
distribution for § is introduced, and the lower 100(l-ar)% confi- 
dence interval (where or » P[type I error]) based on the normal 
assumption is developed* 

EXPLANATION OF WOODS-BORSTING METHOD 
In a system with k components connected in logical series, 
the true system reliability, Rg, may be expressed as 

k 



the component be continuous operating or cycling type. Com- 
ponent reliability may be expressed in terms of unreliability. 




( 1 ) 



where p^ is the true reliability of the i fc ^ component, whether 




P 



i 



i 



( 2 ) 



and hence 



k 



V n (1 " « t > 

s i-1 i 



(3) 



Define 




(4) 
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and, expanding the natural logarithm in an infinite series 
k 

s = q.) - T ( - q t ) 2 + y-( ‘ ^i) 3 - *’*} 

i®i 

k « q^ 

-r rt 

i=l j®l 



( 5 ) 



which may be approximated by the first two terms of the series, 
called for ease of expression. 



S 




( 6 ) 



It is shown in Section 2 that the error due to truncation is 
quite small; in fact. 



k k q ^ 

s s y T + 7-^ 

S L l i ^3(l-q 4 ) 
i=l i~l i 



It can be shown (see Appendix I) that an unbiased estimator for 
T^, call it T^, is 



A 




a. 

x 



<*i 



+ b. 



a 2 
q i 



( 8 ) 



where 

2n. - 3 

a « - 1 (9) 

i 2(^-1) 



b. 

3 , 




A 



q. 

i 




n 



i 



( 10 ) 



( 11 ) 
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n^ being the number o£ units o£ component i that lived out their 

assigned mission time during a test, and f^ the number o£ failures 

of type i observed during the test. Therefore 
k 



A 

S 




( 12 ) 



i®l 



is an unbiased estimator of S. An approximate value for the 
variance of S can be shown to be (see Appendix II) 

k ^ k T i 

Var(S) «^Var(f i ) • (13) 

i=l i-1 i 



Thus, we have the first two sample moments of the random variable 



A 

Next, a two -parameter Gamma distribution is fitted to S by 

A 

the method of moments. If the density of S is taken to be in 
the form 



fA(x;r,0) 



r-1 

x exp(-x/9) 

T (r) e r 




, x>0, r>0, 0>O 



otherwise 



then 



A 

E[s] - 0r - S 

k ip 

A 2 C7 A i 

Var(S) = 0 r * y ~- 
i™l 

Solving these equations for r and 0 
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and thus an estimator r, for r is taken as 



r ® 



(h) 2 /( 

i=l / i=l i 



Since S is assumed to be Gamma-distributed, 2S/9 is distributed 

2 

approximately X . Thus 
2r 



1 - “ - * [ f * H- c , 2r 1 

% 2 ] 

/ X l- a, 2r J 



[' 



P 6r s s 



2r S 



■ ln R s 5 v 2 



1- Of, 2r 



2 th 2 

Where X is the or percentile point in X distribution. 

1- a,2r 2r 



2 

If r ^ 3 and or is small, the quantity 2r/x^ a i® 

almost a constant with respect to r. ...consequently, 
the random variable 2 r /^2 will have small variance 

l-or,2r 

... Thus, from this last equation... [l] 



1 - a = P 



= P 



R £ 
S 



* * * C2f] / x Uc* 

“P C’ * [2i] ,/ V „,[2r] ^ 



where [2r] denotes the smallest integer greater than or equal 

to 2r. The right-hand side of the probability statement is 

therefore the lower confidence limit of the Woods-Borsting 

Method, call it R , and 
S L.C. 
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exp 



(-s[2r] 



L.C 



1- «,[2r] 



) 



ANALYSIS OF THE ERROR DUE TO TRUNCATION 
In the transition from (5) to (6) an infinite series was 
truncated to its first two terms* Examine the inner summation 
of (5) 



CO J 

j=l ^ 



q i 

q + -i- 
* 2 



+ r 

j=3 



q 



j 



(14) 



* T + R„ 
i 2 

where is the remainder of the series after two terms have 
been written out. If we test the n^ and (n + l) st terms of 
this series by the ratio test, 
irt-1 



q 



rt+1 



n q. 



q 11 / n 



rrt-1 



(15) 



we see that this expression is always less than q £ 1, which 
implies the series is convergent. Then by Theorem 24, p. 328 
of [2]. 

, n q. 



lim 

n— 



nfl 



= q. 



which implies that 
.n+1 



R ^ q“ rri / (n+1) (1-r) , r ^ q 
n i / i 



(16) 



(17) 



Since r ^ q , let us choose r s q s 1 so as to make R„ as small 
^ n 

as possible 
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(n+l)(l- qi ) 



(18) 



n +1 



R £ q 
n \ 



and evaluating at n = 2 



Vv 3 < 1 ‘ , i ) 



(19) 



Since « 1 in most cases of interest, choose q^ a , 15 ^ f or 
example, which is about the largest value it will ever take on, 
and we see that R^ 1.4 x 10 ” 3 . Substituting equation (19) into 

(14), m J 

L 

j=l 



0 > 00 / 

V 7 -L- * T. I- q 3 / 3(l-q ) 

L, j 1 1 ' 



( 20 ) 



and substituting (20) into (5) 
k 



S ^ Z (T i + \ 3 / 3 ( 1 - < l i )) 

i=l 



( 21 ) 



which upon distributing the summation sign becomes equation (7) * 
For q^= .05, still quite a large value for q^ to take on, and 
k » 15 

k 

S ^ Y T i + 6 X 10 " 5 , 



( 21 a) 



i®l 

so the approximation 
k 

s i I T i 

iasl 

is quite good. 



( 6 ) 



INVESTIGATION OF ERROR DUE TO APPROXIMATION IN Var ( 3 ) 

In Appendix II the Variance of the random variable S is com- 
puted, and it is seen that the value used in ( 13 ) above differs 
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( 22 ) 



from the true variance by a factor 



Z( 



i-1 



20 ^- 1 ) 



r 3q ' 
{ 1 + - 1 - 



2q, 



- 2q 1 ) 



Upon embarking upon an investigation of the size of this term 
it is quickly seen that it is a task which , due to the amount 
of work involved, is beyond the scope of this thesis. A few 
general comments on this term are in order, however. 

Being a function of both the q^ and n^, equation (22) may, 
for certain combinations of these parameters, actually be less 
than zero and reduce the variance of In order to determine 
when this occurs, it would be necessary to use a digital com- 
puter to compute and plot for each set of n^, i“l, ••*, k, a 
curve over the range 0 s q s l; and, similarly, to compute and 
plot for each set of q^, i“l, •••, k, a curve over the range of 
interest of n^, 2 ^ n^ N, where N might be 150. 

If the summand of (22) is plotted as a function of a single 

q^, with the n^ held fixed, the curve is seen to be bell-shaped 

over the range 0 ^ q ^ 1, but within the realistic range that 

q may be expected to take on, 0 ^ q ^ .15, (22) is a non-de- 
i 1 

creasing function, and strictly increasing unless a point of 
inflection occurs. 

If the summand of (22) is plotted as a function of a single 
n^, where n. is of course integer-valued, it is seen to be a 
mono tone -decreasing step-function, asymptotic to the n^ axis. 

As a crude bound, on the size of the error, consider the 
summand of (22) 
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( 23 ) 




JL + } 

2n. L n. J 



which implies that 

fOL { l+ ^. 

i=l 2(n^-l) n i 



2 «i 




(24) 

(25) 



(26) 



(27) 



which is obviously not a least upper bound, but an example is 



informative. Let n ** 20 for all i, and k “ 15 
k 






(28) 



i»l 



which admittedly is of an undesirable magnitude for an emitted 
term, but (22) is undoubtedly much less than .4. 

INTRODUCTION OF THE NORMAL DISTRIBUTION FIT FOR S 
AND DEVELOPMENT OF THE ASSOCIATED CONFIDENCE INTERVAL 

Now, instead of a two-parameter Gamma distribution as was 

used in [l], assume that the distribution of S can be fitted by 

a Normal distribution with parameters M- and The prob- 

, A 

ability density function of S is therefore 



20 



~=r exp (- -i ( ), a > 0 

. 2 a/2 II 2 a 

,<x;M-,a ) “< v 



( 29 ) 



otherwise 



Again using the method of moments „ 



E[s] - n “ S = - In R 



k Xj 

a 2 V 7 i 

Var(S) “a ® > 

^ n . 



i=l 



(30) 



Let 



a 2 



Z -±- 

L> n. 

i=l i 



(31) 



Then 



r ^ 2n 
E[ a ] 



E 



k m 

i=i 1 



a 

Tj 



k 

r sC ^r ] 



i»i 



(32) 



k x 

E~r 



i=i 



. 2 2 
and a is an unbiased estimator of a* . 

A 

Now, based upon the normality assumption on S, 



1 - a - P [ 



A 

s-s 



2 - 



(33) 



Where is the ordinate of the tabled standard normal distri- 
bution exceeded with probability a . Multiplying by -1, 
equation (33) becomes 



1 - or « P [■ 



A 

S-S 



* K ] 

a 



(34) 
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which may be approximated by 



l-o-»p[si£S + K a a] 



(34a) 



* p Cs * s u(c) 3 



if o is the square root of the unbiased estimator of a • Since 



o was seen to be unbiased, let 



k £ 






'i=l 



(35) 



Putting in the values for S and a in (34a) 

k 

s£ r i i +K a 



1 - O' ■ P 



i=l 



k A 

i»l 1 J 



k 

I 

i=l 



r\ 

k t 3 



l “* S £ I T V V £ H 



i=l 



(36) 



R S 
S 






which is an approximate lower 100(1- or)% confidence interval on 



R_. The associated lower confidence limit, call it R c , . , is 
S s ,L(a) 

» . . - -(I; 1 ■ * -JJJt) 



S,L(0') 



Substituting equations (8) through (11) in the above express- 
ion, the result is 



k f- - • f .2 



*>i /Vi Mi 



which is a random variable whose distribution is unknown, 
although it is a function of the Binomial random variables 
f^, i ■ 1, • • • , k and the parameters n^ and k. Thus, to 
evaluate the worth of this confidence limit it is necessary 
to simulate the distribution of this random variable# 
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3. SIMULATED DISTRIBUTION OF CONFIDENCE LIMIT AND RESULTS 



In this section the digital computer simulation of the 

A 

distribution of S + o is explained, as is the method of 
testing the accuracy of the results of this simulation. 
Several histograms of the computer-simulated distributions 
are presented in Figures 1 through 4, with a discussion of 
the shapes of these histograms. The results of the computer 
simulation are presented for ten different combinations of 
the input parameters in Table I and these results compared 
with the same cases of the Woods-Borsting Method in Table II. 

SIMULATED DISTRIBUTION OF THE CONFIDENCE LIMIT 
AND MEASURE OP ACCURACY 

In order to simulate the distribution of the confidence 
limit, the input parameters k, n^, i = 1, •••, k, and 
p, ®* 1 - q^, i ■ 1, •••, k are chosen and used as inputs 

to be computer program. The values chosen are given in 
Table 1. Using true values, the following are computed 

in order that they may be compared with the simulated 
values: 
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( 1 ) 



R 



S 



k 

= n 

i-1 



p 



i 



T = q + ~ — , i = 1, • • • , k 

i i 2 



S 



k 




i 






( 39 ) 

( 6 ) 



( 4 ) 
( 40 ) 

Note that S is computed two different ways in order to see the 
effect of the truncation of the logarithmic series. 

Next, the simulated values are generated by the program. 

A three digit random number is obtained using a uniform random 
number generator subroutine. If the random number is greater 
than p^, a failure is "counted" by the computer; if the random 
number is less than or equal to p^, no "count" is made. This 
random number generation is done n^ times for each p^. Thus 
the number of failures counted divided by the number of units 
of that component becomes and estimator of unreliability for 
that component; i.e», 




The whole process is repeated k times, giving an estimator for 



S ■ -In R s 
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each q^. Several arithmetic operations are performed by the 
computer with these q^ resulting in computation and storage for 
further use of the following simulated values: 







b i<*J 



A 

q. 



( 8 ) 



s 




( 12 ) 



A 

a 




(41) 



In order to complete the simulation of the distribution it 
was decided to make 500 replications of the above procedure. 
Thus 500 values each of (12) and (41) are computed and combined 
in the form 




for each value of a. Three values, .05, .10, .20, were chosen 
for a . The 500 points of the distribution were then sorted, 
by size, by a separate subroutine. The distribution was printed 
out in its entirety in order that a frequency histogram could be 
plotted, and the O ' 1 " 11 percentile of this distribution, call it A, 
was found by the computer. Then e”^ was computed and printed 
out for comparison with true system reliability, R • 

w 
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Consider the underlying meaning of the probability state- 



ment 



V R s,L(c) ] • 1 - « 



(43) 



If the probability density function of Rg l(cc) * s Plotted on a 

coordinate system, and R is taken to be a point on the abscissa, 

b 

then (1 - a)% of the area under the curve lies above and o' Z lies 

below Rg. Therefore, R g should be equal to the or** 1 percentile of 

the distribution of R which we have called exp(-A) above. 

SjMQ') 



| Rg- exp(-A) | (44) 

is a measure of the accuracy of the procedure under investi- 
gation. This difference is shown in Table I for all cases 
simulated. 



DISCUSSION OF SHAPE OF DISTRIBUTION 
As will be seen in Table I, ten different combinations of 
the parameters k, n^, and p^ were selected for computer simu- 
lation; for each of these ten combinations three values of a, 
.05, .10, and .20, were used, for a total of 30 different dis- 
tributions simulated. Four of these 30 were chosen as illus- 
trative of the effect the parameters have on the shape of the 
distribution, and are included as Figures 1 through 4. In all 
cases illustrated O' = .20 and k ® 15, except Figure 2 where 
k » 13. All the figures utilize class intervals of width .025. 
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Frequency 







FIGURE 1 

HISTOGRAM 0? DISTRIBUTION FOR CASE 



All four are skewed right in varying degree, having greater 
than 50% of the area below the mean. 

In Figure 1, the n^ are all equal as are 14 of the 15 p^. 

The remaining p « .85, is considerably lower than the 
rest. In this case, sis of the 12 class intervals in the 
lower tertile have zero frequency, and these six are not 
adjacent, rather are interspersed with class intervals of high 
frequency. Overall the distribution is multimodal and and has 
a range of .8868. The standard deviation is .136. 

In Figure 2, both the n^ and p^ vary greatly, 5 ^ n^ 150, 
.900 ^ p^£ .995. This distribution is unimodal, and, except for 
an area between the S? 1 -* 1 and 96 t * 1 percentiles, approximates a 
right-skewed bell-shaped curve. The range of the distribution 
is *9545, from .108 to 1.0625; the standard deviation is .153. 

All are equal, but the n^ vary greatly, 15 ^ n^ 250, 
in the next case, shown in Figure 3, The distribution is 
unimodal, and closely approximates a bell-shaped curve, with 
a slight degree of skewness to the right. Here is the smallest 
range, .3696, and the smallest standard deviation, .06, of all 
distributions simulated. 

The last case displayed. Figure 4, has relatively small 



values for the p^, .95 for the first 14, and .85 for the 15 



th 



The n^ are all equal to 20. This distribution is erratic over 
its entire range, the class intervals alternating from low to 
high frequency. The range of the distribution is 1.4063, but 
it is interesting to note that the distribution is shifted much 



29 



Frequ?.n 

























ON 


ON 






1 ^ 


tn 


ON co 


CN O 


o 


o 


m o 


LA 


co 


00 


00 


tA 


b 


v-u on 


00 


co 


CO co 


vD O 


00 


CN 


r". 


ON 


vO 


CM 


CO 


H 




Cu ^ 


on 


ON ON 


ON CN 


ON ON 


CN 


ON 


O'. 


ON 


on 


oo 


CM 


<5* 


•f 


i • 


























<01 






















12 


H 


0 


U 


•i-t l o 


o 


lA O 


LO CO 


CO ON 


tA 


LA 




iA 


CN 


in 






,~s 


c : m 


on 


o 


CN t-i 


CM H 




CN 


vO 


CM 


tr* 


cd 


<4 


\'A 


b 


* r-i 




r*~» 


t— 4 






r-i 




r-i 
































r* 




























i-l 






<01 






















1 










CM 


CO 


IA O 


co 


CN o 


r— l 


<N 


CA 










i 












r-i 


r-J 




i—4 










o 

cm 




30 



FIGURE 2 

HISTOGRAM OF DISTRIBUTION FOR CASE 3 
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HISTOGRAM OF DISTRIBUTION FOR CASE 4 



Frequency 
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HISTOGRAM OF DISTRIBUTION FOR CASE 5 



further to the right on the S , x axis than the previous dis- 
bar) 

tributions, its lowest value being .5251. This distribution 
also shows large dispersion about its mean, with a standard 
deviation of .232. 

From these form illustrative cases, coupled with an analysis 
of the other 26 cases which are not graphed, some general con- 
clusions as to the shape of the distribution can be made. As 
the p^ decrease in value, the range of the distribution increases 

A 

and the distribution shifts to the right on the S „ . abscissa. 

U(cO 

If the p^ are varied instead of constant, the dispersion of the 
distribution about its mean is larger. If the n^ are varied, 
the distribution can take on a larger number of discrete values 
within its range, and the distribution becomes unimodal. 

RESULTS 

The results of the 30 cases, ten different combinations of 

the parameters k, n., and p for each of three values of or, are 

i i 

presented in Table I below. In Table II, the results are com- 
pared with the Woods-Borsting Method. 

Column (1) of Table I is self-explanatory. The headings 
of the rest of the table have been previously defined above, 
but are reiterated here for use in referring to the table. 

Column (2) is the number of components in the system. Column 
(3) is the size of the sample tested for each component of the 
system. Column (4) is the probability of success for each 
component of the system. Column (5) is the system reliability 
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table i 



( continued ) 
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based on the input parameters of columns (2) through (4) . 

Column (6) is the value of a which divides each case into 
three parts* The mean and variance of the distribution of 

5 + K.^ o are shown in columns (7) and (8) . Column (9) is the 

th 

exponential of the ot percentile of the distribution, and 
column (10) is the difference between columns (9) and (5), 
the measure of accuracy of the procedure. 

In Table I, cases 1 and 6 are identical except that the 
number of failures, f^, were generated by the computer using 
different entry points to the random number generator sub- 
routine* Comparing the values of |exp(-A) -Rg| for these two 
cases, it is seen that they are the same for O' = .05 and 
ot = .10, and differ only in the third decimal place for ot = .20. 
Therefore, it appears that 500 replications of each case is 
sufficient to overcome random fluctuations in the numbers gen- 
erated, and it was to investigate this area that these two 
cases were chosen identically. In reading Table I, one should 
compare cases, 1, 6, 9, and 10, as 9 and 10 differ from 1 and 

6 only in choice of one of the n^; and 9 and 10 differ from each 

other only in the p with which this one different n. is asso- 

i i 

ciated. Case 8 is also comparable to the above four cases, the 
difference here being that the n^ were increased from 20 to 50 
for all i, which appreciably increases the accuracy of the pro- 
cedure. The results of cases 4 and 7 should also be compared 
as they differ only in the choice of n^, and again it is seen 
that the larger the n^, the better the accuracy, all other things 
being equal. 
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To see the effect of the on the accuracy of the procedure , 
consider cases 3, 5, 6. In case 3 the average p^, call it 
p^^ ■ .9702; for case 5, p^ ■ .9433, and in case 6, p^ * .9853. 

At the or = .05 level, the accuracy improves as p^ decreases, 
which is as it should be. As the p^ decrease the increase, 
and thus when the random number generator subroutine computes 
f^, the number of failures, there exists a greater number of 
discrete values f^ can take on, hence a correspondingly greater 
number of values S + a can take on in the lower tail of the 
distribution. It is therefore more likely that the 5^ per- 
centile of the distribution will be close to R^. In general, 
the worst results are for the distributions in which or - .05 due 
to the sparsity of different discrete values the distribution 
can take on. 

In general, the results were not too satisfactory. In 

only five of the 30 cases was exp(-A) within .01 of the true 

system reliability, R . Of considerable importance is the fact 

b 

that in every case the difference exp(-A)-R c was positive indi- 

b 

eating that the values of A, the Qf^ percentile of the distri- 
bution, were too small. This led to the addition of a continuity 
correction factor, developed in Section 4, to compensate for the 

A 

fact that S, in reality a discrete random variable, was fitted 
by a continuous probability distribution. 

Table II compares the above results with the results of the 
Woods -Bor sting Method. Columns (1), (2), (3), (5) and (7) were 
used in Table I, and are identical in definition here. Column 
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TABLE II 



COMPARISON OF V/ OODS - BOR S TING METHOD AND COMPUTER SIMULATION 
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(4) is the Qf t * 1 percentile of the distribution R of [l], and 

S 

column (6) is a measure of the accuracy of the Woods-Borsting 
Method* Table II does not include all the cases simulated in 
[1], rather only those which are identical to the cases of 
Table I* As mentioned in the Introduction, the average error 
in the Woods-Borsting Method was .036 for all cases simulated. 
The average of column (6) is .032 while the average of column 
(7) of Table II is *03, so at least based on these average 
error figures the fitting of a Normal distribution rather than 
a Gamma, to S appears to be slightly better, but not signifi- 
cantly. 

The cases of principal interest are those where component 
sample sizes differ, since this is the problem the procedure 
was designed to cope with. These are cases 3, 4, 7, 9, and 
10. The average error for these cases under the normal dis- 
tribution assumption (column (7)) is also .03, so it appears 
to be no better or no worse for varying sample sizes than for 
constant sample sizes, based upon the few cases presented in 
Table II. 
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4. SIMULATED DISTRIBUTION OF CONFIDENCE LIMIT WITH CONTINUITY 
CORRECTION FACTOR, AND RESULTS 

This section is devoted to a heuristic development of the 
continuity correction factor mentioned above, a presentation 
in Table III of the results of the same ten cases with the 
correction factor included, and a comparison of these results 
with the results of the Woods-Borsting Method. 



DEVELOPMENT OF CONTINUITY CORRECTION FACTOR 

Since S is a random variable able only to take on discrete 
values, but was assumed, in (29), to be a normal random variable, 
a continuity correction was deemed necessary. Consider (8) , in 
which (9) through (11) have been substituted 
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2n t - 3 
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n i 
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3) f. + f ± - 



2n i (n^l) 



(45) 



For every possible number of failures, 0 ^ f^s n., assumes 
a different value, and if these values were plotted on the 
real line, the size of the interval between adjacent values 

A 

would vary due to the nature of T^. It was felt that, just 

as in the Normal approximation to the Binomial (where the 

continuity correction factor is , if n is the sample size), 

2n 

the continuity correction factor should be related to the size 
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of the interval. Toward this end define 
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T ' - T (47) 

and if the size of this interval is normalized by dividing by 
the sample size, n^, and arbitrarily take h the result, then 
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is the continuity correction factor added. Notice that when 
* 0, which it will a large majority of the time because 
q^« 1, the continuity correction factor reduces to 

1 _ 

2n £ 2 (49) 



Define 



T * - T + 
i i 




then it follows that 



S* 




a*- 




(50) 
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which may be combined in a probability statement similar to 
(34a) 

1 - a & P [s * S* + K a a*] (52a) 
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and the new lower 100(1 - (*)% confidence interval, comparable 
to (36) , is, 
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and associated lower confidence limit is 



R* 



S,L(ff) 



“ exp 




( 54 ) 



the distribution of which is simulated as before for exactly 
the same ten cases, and the results are given in Table III. 



Figures 5 through 8 below are identical to figures 1 
through 4, except that the simulated distributions plotted 
have the continuity correction factor added. There are no 
significant differences apparent; all four of the distributions 
with the correction factor added have essentially the same shape 
as their respective predecessors. All of the general comments 
made with respect to the first four figures also apply to these 
four, and they are presented for comparison purposes only. 



The results of the same 30 cases, but with the continuity corr- 
ection factor added, are presented in Table III below. The 
results are compared with the Woods-Borsting Method in Table IV, 
and with the results before the continuity correction factor 
was added in Table I. 

Table III is almost identical to Table I, the only diff- 
erences being in columns (7) and (8), which are the mean and 
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HISTOGRAM 0? DISTRIBUTION WITH CONTINUITY CORRECTION 
ADDED FOR CASE 1, O' ~ .20 
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FIGURE 6 

HISTOGRAM OF DISTRIBUTION WITH CONTINUITY CORRECTION 
ADDED FOR CASE 3, O' « .20 
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HISTOGRAM OF DISTRIBUTION WITH CONTINUITY CORRECTION 
ADDED FOR CASE 4, or *» .20 
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HISTOGRAM OF DISTRIBUTION WITH CONTINUITY CORRECTION 
ADDED FOR CASE 5, or = .20 
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TA3L2 III 



( continued ) 
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variance of the new simulated distributions with continuity 

correction included, and in columns (9) and (10) where A* has 

th 

been used to denote the ot percentile of the distribution with 
correction factor included. Cases 1 and 6, which are identical 
except for the entry point into the random number generator, are, 
as in Table I, identical in column (10) for or ■ .05 and .10, and 
differ only in the third decimal place for or = .20. Cases 1, 6, 
8,9, and 10 are very similar and should be compared to each 
other in reading the Table. Cases 4 and 7 are also comparable 
to each other. Cases 3, 5, 6 show the affect of the p^ on the 
accuracy of the procedure. 

The overall picture presented by Table III is much more 
encouraging than that of Table 1. In nine of the 30 cases the 
measure of accuracy (column (8)) was less than .01 and in two 
more was less than .0105, and considering the number of signi- 
ficant figures in the input parameters, the results are prob- 
ably not significant to four decimal places, so these two could 
be taken as equal to .01, giving 11 cases less than or equal to 
.01. The average difference in magnitude between e”^* and R 

b 

was .017. For cases 3, 4, 7, 9, 10, the ones in which com- 
ponent sample sizes vary, the average difference was .012, a 
slight improvement. 

Table IV compares the results with the continuity correction 

factor to the results of the Woods -Bor sting Method. This Table 

is identical with Table II with the exception of columns (5) and 

th 

(7), where A* has been used, vice A, to denote the o/ percentile 
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TABLE IV 
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of the new distribution with correction factor added. As in 
Table II, the entries in the body of the Table have been rounded 
to two significant figures due to the nature of the input para- 
meters. The average error in column (7) with the continuity 
correction factor added is .017, and is significantly less than 
the average error of column (6) , .036, for the Woods-Borsting 
Method. However, it is noteworthy that this high average is 
attributable to three large values. Taking away the three 
largest values from both column (6) and (7) , the column averages 
become .023 and .021, respectively, which are insignificantly 
different. 

In Table V the results obtained before the continuity 

correction factor was added are compared to the results obtained 

upon introducing the correction factor. The body of the table 

gives the number of cases for which the magnitude of the measure 

of accuracy was within the range specified in column (1). The 

sizes of intervals in columns (1) were so chosen because of the 

fact that |r - exp(-A) | is only accurate to two places, even 
b 

though computed to four places. For example, the four-place 
value .0142, when rounded off becomes .01, hence the choice of 
the second interval of .0051 to .0150. The addition of the 
continuity correction factor made a marked improvement in the 
results as can be seen both in the average value of the accuracy 
measure, .028 before, compared to .017 after, and in the in- 
creased number of cases that fall in the intervals representing 
the best accuracy. Before the continuity correction was added 



52 



TABLE V 



COMPARISON OF COMPUTER SIMULATIONS WITH AND 
WITHOUT CONTINUITY CORRECTION FACTOR 



(1) 

|R s -exp(-A) | 


(2) 

without 

CC 


(3) 

with 

CC 


.0000 — .0050 


2 


4 


.0051 — .0150 


6 


15 


.0151 — .0250 


7 


6 


.0251 — .0350 


10 


1 


.0351 ~ .0450 


1 


2 


.0451 — .0550 


1 


0 


.0551 — .0650 


0 


2 


.0651 — .0750 


0 


0 


.0751 — .0850 


3 


0 


> .0850 


0 


0 


TOTAL 


30 


30 


Average Accuracy 
|R g -exp(-A) | 


.028 


.017 



53 



only one-half the cases were within .025 of true system 
reliability, while after the addition of this correction, 25 
of the 30 cases had accuracy better than .025* Additionally, 
prior to the use of the correction factor, there were three 
cases in which the accuracy was no better than .075, whereas 
upon adding the correction factor, there were no cases worse 
than .06. Based on these 30 cases it is amply apparent that 
the continuity correction factor improves the procedure 
considerably, and considering the fact that (52a) is an appro- 
ximate confidence interval, this procedure appears usable in 
situations where rough lower bounds on system reliability are 
permissible. 

* 
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5. CONCLUSIONS AND ACKNOWLEDGEMENTS 



In this section the results of [l] and the results of this 
thesis are compiled together in Table VI, comparisons are made 
and results discussed. Secondly, general conclusions based on 
the entire thesis and recommendations for further investigation 
are made* 



TABULATION OF OVERALL RESULTS 

In Table VI are presented the results of computer simu- 
lations of four different approaches to the problem of obtaining 
a lower 100(1 - a ')% confidence interval on system reliability. 
Two of the four are from [l], the well-known Poisson approxi- 
mation and the Woods-Borsting Method. The remaining two are 
the ones developed in this thesis, fitting a normal distribution 

to S, both with and without a continuity correction factor. 

til 

Column (4), Y a , is the a percentile of the simulated dis- 
tribution of a confidence limit involving a Chi-square random 
variable and based on the Poisson approximation to the Binomial* 
Inherent in this procedure the fact that sample sizes of all 
components must be equal, hence no entries can be made for cases 
3, :4, 7, 9, and 10. The rest of the column headings have been 
explained above, either in connection with Table II or Table IV. 
If all four methods were perfectly accurate, all the entries in 
columns (4) through (7) would exactly equal column (2) . 

Notice how poor the Poisson approximation is in Case 5, a 
case where the p^ are relatively small (see Table I) , and in 
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TABLE VI 
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CORRECTION FACTOR, POISSON APPROXIMATION, 
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case 2. The procedures recorded in columns (5) through (7) 
also have places where accuracy is bad, but these occur for 
the most part in cases where a m .05, which is to be expected, 
for the reasons mentioned in Section 3. From Table VI one can 
see that these three procedures display much more consistency 
in their accuracy than does the Poisson approximation method. 
The average error of the Poisson approximation is .049, and 
reiterating, the average errors for columns (5) through (7) 
are .036, .028, and .017 respectively. 

SUMMARY 

In the preceding three sections, an approximate lower 
100(1 - a)% confidence interval on system reliability has been 
developed, based on the procedure of [l], but differing from 
[l] in that the probability distribution fitted to S by the 
method of moments is normal rather than Gamma. The lower con- 
fidence limit of this confidence interval is a random variable, 
and in order to test the accuracy of the approximate confidence 
interval, the distribution of this confidence limit was simu- 
lated by digital computer, and its percentile compared to 
true system reliability. Figures 1 through 4 are histograms of 

four representative distributions; the reasons for their shapes 

/ 

are discussed. The level of accuracy obtained was not satis- 
factory, and hence a continuity correction factor was developed 
and added to the lower confidence limit. The distribution was 

again simulated by computer, the histograms of the same four 

th 

distributions were plotted, and the or percentiles of all 30 
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cases were compared to true system reliability as a measure of 
accuracy of the procedure® The changes in shape of the four 
distributions plotted were negligible. 

In conclusion, it appears that the method developed above 

A 

by fitting a normal distribution to S without continuity corr- 
ection factor is no better or no worse than the method developed 
in [l] by fitting a Gamma distribution to S. Both have several 
large errors in accuracy, and both have average accuracy error 
on the order of .03® After the continuity correction factor is 
added the method of this thesis is certainly better than the 
same method before the continuity correction factor was added, 
as can be seen from Table V, and appears to be better, on the 
basis of average accuracy, than the method of [l]. However, 
in examination of Table IV, cases 4 and 8 have better accuracy 
by the Woods -Bor sting Method, so one must conclude that neither 
of the methods is universally better than the other. It is not 
realistic to compare the method of [ 1] to the method developed 
above with continuity correction factor, because no correction 
factor has been added to the former, a point mentioned by, and 
currently under investigation by the authors of [1]. Another 
conclusion that eeae as a by-product of this investigation is 
that one should use the Poisson approximation with great skep- 
ticism as the results are evidently not at all consistent in 
their accuracy. 

It appears that further investigation of this entire 
procedure is called for, and some recommendations as to the 
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paths this investigation should take are mentioned below. 

First, no variation in k, the number of components of the 
system, was made, and this is certainly a cogent area for 
exploration to see what effects this parameter has on the 
accuracy. Secondly, it would seem desirable to simulate a 
great many cases, with different combinations of the parameters 
k, p^, n^, with an eye toward devising a set of rules by which 
one could decide in advance which method would give the best 
results, dependent upon the parameters involved. It is im- 
possible to make any statements of this kind with only ten 
different combinations of parameters to examine. A third area 
for further investigation is one already mentioned in Section 2, 
that of investigating the error involved in truncation of the 
expression for the variance of S. 

I would like to thank Dr. W. Max Woods of the Operations 
Analysis Department of the U. S. Naval Postgraduate School for 
suggesting this problem to me, for allowing me to use the pro- 
cedure of [l] as a starting point, and for the helpful sug- 
gestions given me throughout the course of this investigation. 

I would like to also acknowledge the help of Dr. Rex H. Shudde, 
also of the Operations Analysis Department, for allowing me to 
use the computer program he developed for the procedure of [l], 
to which only minor modifications were necessary, and for the 
assistance in programming he gave me. 
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APPENDIX I 



DERIVATION OF T . , THE UNBIASED ESTIMATOR OF T 



In order that T^ be an unbiased estimator of T^, it is 
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Then equating coefficients of and 
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and solving simultaneously 
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Thus, 
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is an unbiased estimator of T ? . 
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APPENDIX II 
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i i ii ii i i i i 

4 3 2 

6 n i q i + " 7 n i q i + n i q i 



Therefore 
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(2n i -3) n. 

2 (n r l ) 2 ni 3 
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i n ^q ^ - 6n **q ^ + 6n ^q ^ + lln 
I i i i i i i i 1 



4(n -l) 2 n 4 
1 i 



2 ^ 2 o 4 

18n q + 7n q 2 - 6n q 
i i i i ii 



+ l2n , q . 3 “ 7n.q. 2 + n q } 
i i ii l i J 
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4(n r l)V 



+ 2q. 3 + 3n i q i 2 -3^+q^ 
4(n.-l) 2 n i 



(n^q, 4 -6n. 2 qi 4 + lln ^^' 1Sn i q i J+ 7 \*L 



4(n -1) n 
i i 



6q_ 4 + 12q. 3 - 7q. 2 + q.) 

4(n -l) 2 n 
i i 



n \q 4 + 4q. 3 + < *q i 2 ) + “i 2 \ 2 + 4 ' 1 i ) 

i 1 1 1 
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+ V 11 ^ 4 + sq i 3 ' 2q i 2 - 8q i ) 
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i i 



(”6q. + 2q. + 4q ) 
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.2 



4n . (n . - 

i i 



Let 



Then 
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A = q + 4q 3 + 4q ' 
i i i 



a 3 2 
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i i i 1 
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i i 1 i 



D 0 -6q ^ + 2q 2 + 4q^ 
i i i 
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4n (n -1)‘ 
i i 
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-qi 4 -qi 3 + q i 2 + ( 2 q i 4 -4q i 3 +2q 1 2 )n 1 

n i 4n i< n i-l) 2 



-(2q. 4 - 4 qjL 3 + 2 qi 2 ) 

4 n i ( n i "l) 2 



2 + + i 2 + li! . (q i 3+q i 4 ) ^ 
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- + - 



eCt/] - t 4 2 = var(i.) ^ ~ + ~ ~ * (q< + q 2 )+ 



1 n i n i 



(q^i) 2 

2(n.-l) 



which, when simplified, gives 

„ rf , T 1 + i i 2 f 3 0i 2 -i< 2 ii 2 + 2 ‘>i 

Var(T i > ■ it —] ; 

i i C 2(n.-l) 



1) 






n i 2(n^-l) 



3q 



1 + _L. - 2, 2 - 2q> 



which we approximate by 
T 
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i 

k T 

Var(S) = [ IT 
i 53 ! 



and the truncation error is 
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~) 
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